A Fitness Proportionate Reward Sharing: a Viable Default Hierarchy Formation Strategy in LCS
نویسندگان
چکیده
The learning task in a Learning Classifier System (LCS) is aimed at building a set of rules that work in coordination to accurately model a given environment. The addition of the hash symbol (‘#’) in LCS’s condition provides varying degree of coverage to environmental niches. Building a hierarchical set of rules, where accurate and more specific rules respond to a subset of the situations covered by more general but less accurate default rules will be vital to achieve a compact rule set size, especially when dealing with an environment that has huge numbers of states. However, the formation of viable default hierarchy in LCS has been a nightmare in this research area for decades. This paper presents a new resource allocation scheme that leads to the formation of a default hierarchy in LCS. A fitness proportionate reward sharing scheme is introduced and the performance of the algorithm is tested using known test functions.
منابع مشابه
Tournament Selection: Stable Fitness Pressure in XCS
Although it is known from GA literature that proportionate selection is subject to many pitfalls, the LCS community somewhat adhered to proportionate selection. Also in the accuracy-based learning classifier system XCS, introduced by Wilson in 1995, proportionate selection is used. This paper identifies problem properties in which performance of proportionate selection is impaired. Consequently...
متن کاملNew Perspectives about Default Hierarchies Formation in Learning Classifier Systems
In this paper we present some results of research in default hierarchies formation. A default hierarchy is a set of rules that models a set of environmental states in which some default rules cover most of the environmental states while specific ones cover exceptions. It is well known that default hierarchies can be used to categorize environmental states very efficiently. In fact, a default hi...
متن کاملRevisiting UCS: Description, Fitness Sharing, and Comparison with XCS
This paper provides a deep insight into the learning mechanisms of UCS, a learning classifier system (LCS) derived from XCS that works under a supervised learning scheme. A complete description of the system is given with the aim of being useful as an implementation guide. Besides, we review the fitness computation, based on the individual accuracy of each rule, and introduce a fitness sharing ...
متن کاملQuantification of Social Behavior in D. discoideum Reveals Complex Fixed and Facultative Strategies
Understanding the maintenance of cooperation requires an understanding of the nature of cheaters and the strategies used to mitigate their effects. However, it is often difficult to determine how cheating or differential social success has arisen. For example, cheaters may employ different strategies (e.g., fixed and facultative), whereas other causes of unequal fitness in social situations can...
متن کاملLearning Classifier Systems Approach for Automated Discovery of Crisp and Fuzzy Hierarchical Production Rules
This research presents a system for post processing of data that takes mined flat rules as input and discovers crisp as well as fuzzy hierarchical structures using Learning Classifier System approach. Learning Classifier System (LCS) is basically a machine learning technique that combines evolutionary computing, reinforcement learning, supervised or unsupervised learning and heuristics to produ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012